SUPPORT / SAMPLES & SAS NOTES
 

Support

Problem Note 49866: Performance degradation might occur in SAS® Merchandise Data Integration during downloads when running dimension load

DetailsAboutRate It

When running the SAS Merchandise Data Integration mdi_loaddm_merch_cmast and mdi_loaddm_merch_hierarchy jobs, the program performs both of these tasks:

  • downloads db_dictitionary for all table objects
  • creates run-time SAS code for each table object that handles default and null values

Performing both tasks impacts the overall performance of the jobs.

In addition, the post-hierarchy load process executes reclass-related steps each time the load runs. The steps should run only during the reclass process (when UPDATE_HIERARCHY=Y). Running the additional steps impacts the overall performance of the hierarchy load.

To improve the performance issue, create run-time SAS code only for hierarchy-related table objects that handle default and null values. To address the post hierarchy load issue, add a validation to run the reclass-related steps only when UPDATE_HIERARCHY=Y. Contact SAS Technical Support to get replacement mdi_loaddm_merch_hierarchy.sas and mdi_loaddm_merch_cmast.sas files that address each issue.

To implement this solution, follow these steps.

  1. Make a backup copy of the following files:
    $MDI_ROOT/code/sascode/mdi_loaddm_merch_hierarchy.sas
    $MDI_ROOT/code/sascode/mdi_loaddm_merch_cmast.sas

  2. Save the replacement mdi_loaddm_merch_hierarchy.sas and mdi_loaddm_merch_cmast.sas files in $MDI_ROOT/code/sascode.

A fix for this issue is planned for a future software release.



Operating System and Release Information

Product FamilyProductSystemProduct ReleaseSAS Release
ReportedFixed*ReportedFixed*
SAS SystemSAS Merchandise Data Integration64-bit Enabled Solaris6.1.3 M66.49.1 TS1M3 SP49.4 TS1M0
64-bit Enabled AIX6.1.3 M66.49.1 TS1M3 SP49.4 TS1M0
Microsoft Windows Server 2003 Standard Edition6.1.3 M69.1 TS1M3 SP4
* For software releases that are not yet generally available, the Fixed Release is the software release in which the problem is planned to be fixed.